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ABSTRACT 


This  study  investigated  the  effects  of  prompting  (P)  and  con¬ 
firmation  (C),  and  of  three  combinations  (PP,  PC,  and  CC)  of  these 
in  the  learning  of  a  Boolean  algebra  program. 

One  hundred  and  five  high  school  mathematics  students,  classified 
into  three  intelligence  levels,  served  as  subjects.  Each  level  was 
then  divided  into  three  random  experimental  groups  (PP,  PC,  and  CC)* 
Subjects  in  each  experimental  group  worked  through  each  lesson  twice 
in  the  learning  situation.  Group  PP  worked  through  the  lessons  both 
times  under  the  prompting  condition;  Group  PC  had  prompting  first 
and  confirmation  second;  Group  CC  had  confirmation  both  times.  For 
the  PC  and  CC  groups,  the  second  trial  served  as  an  acquisition  test. 
Repeated-item  and  transfer  tests  were  given  at  tne  end  of  7-  and 
21-day  intervals  to  all  groups. 

It  was  hypothesized  that:  (1)  the  PC  combination  would  be  su¬ 
perior  to  the  CC  combination  for  acquisition  of  associations,  and  to 
the  PP  combination  for  retention  of  associations;  (2)  the  PC  and  CC 
combinations  would  produce  higher  transfer  scores  than  the  PP  combina¬ 
tion;  and  (3)  the  brightest  students  would  be  less  affected  by  these 
combinations  of  experimental  variables  than  the  other  students# 

Hone  of  the  above  hypotheses  was  confirmed  by  analysis  of  the 
main  effects  of  the  experimental  treatments.  Tests  of  the  simple 
effects  of  these  treatments  revealed  evidence  contradictory  to  the 
first  part  of  the  first  hypothesis#  The  double  confirmation  proce¬ 
dure  (CC)  resulted  in  significantly  lower  error  scores  on  acquisition 
tests  than  did  the  mixed  procedure  (PC)  for  the  upper  and  lower  in¬ 
telligence  groups#  (For  the  middle  group,  the  mixed  procedure  was 
superior  for  acquisition#)  All  these  simple  effects  decreased  over 
retention  intervals# 

In  the  case  of  the  third  hypothesis,  the  acquisition  scores  of 
the  ’upper  intelligence  group  were  differentially  affected  by  the  ex¬ 
perimental  treatments#  Differences  were  statistically  significant, 
although  they  were  of  smaller  absolute  magnitude  than  corresponding 
differences  in  the  other  two  intelligence  groups# 

Despite  the  uniform  requirements  of  all  subjects  to  write  in 
responses  to  frames,  training  times  for  the  treatment  combinations 
involving  confirmation  (CC  and  PC)  were  significantly  longer  than 
those  for  the  double  prompting  condition  (PP)# 


-ii- 


It  vras  concluded  that  the  experimental  variables  were  relatively 
weak  in  influencing  responses,  in  comparison  to  the  response  control 
exerted  by  the  cues  in  the  stimulus  elements  in  the  frames,  and  by 
the  concepts  interrelating  the  frames* 
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THE  RELATIVE  EFFICIENCY  OF  DIFFERENT  COI IMITATIONS  OF  PROMPTING 
At  ID  CONFIRilATION  FOR  LEARNING  A  BOOLEAN  ALGEBRA  PROGRAM 

SECTION  I.  INTRODUCTION 

The  study  of  programed  learning  in  the  context  of  learning 
theory  is  gradually  coming  to  receive  the  attention  it  deserves. 

As  experimental  studies  accumulate,  the  weight  of  their  evidence 
may  clarify  issues  which  are  now  in  doubt,  and  hopefully,  may  load 
to  more  satisfactory  guides  for  the  development  and  application  of 
programs. 

An  issue  which  rocently  has  been  a  topic  for  research  has  been 
the  paired-associate  versus  the  operant  conditioning  method  of  pre¬ 
senting  the  correct  answer  to  a  frame.  The  correct  answer  may  be 
given  before  the  subject  is  required  to  respond  (prompting)  or  after¬ 
ward  (confirmation) ,  In  either  case,  the  subject  sooner  or  later 
leams  to  give  a  particular  response  to  a  particular  stimulus  term. 

In  verbal  learning,  the  simplest  way  to  describe  tills  is  to  say  that 
an  association  has  been  formed. 

Recent  work  by  Rock  (1?57)  and  Estes  (I960)  suggests  that  asso¬ 
ciations  are  formed  on  an  all-or-none  basis  in  one  trial,  Estes 
presented  a  series  of  what  he  called  "miniature  e^erimonts,"  in 
which  a  number  of  different  kinds  of  stimulus  objects  and  experi¬ 
mental  situations  were  used.  All  supported  the  notion  that  either 
an  association  is  formed  or  it  is  not,  and  if  it  is  formed,  only  one 
trial  is  required.  In  these  experiments,  Estes  found  no  evidence 
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that  repetition  gradually  increases  associative  strength.  On  the 
contrary,  he  concluded  that  repeated  trials  in  the  paired-associate 
situation  served  merely  to  give  repeated,  opportunities  for  the  dis¬ 
continuous  formation  of  the  learned  associations  between  observed 
stimuli  and.  responses.*** 

Estes  (i960)  also  tested  the  hypothesis  that  after  an  associa¬ 
tion  has  once  been  formed,  the  associative  strength,  measured  by 
resistance  to  forgetting,  continues  to  grow  as  a  function  of  rein¬ 
forcement,  In  his  experiment,  following  either  one  or  two  reinforce¬ 
ments,  a  sequence  of  two  unreinforced  test  trials  was  given*  Reten¬ 
tion  was  measured  in  terms  of  the  proportion  of  instances  in  which 
a  correct  response  to  a  given  stimulus  on  the  first  of  these  tests 
was  repeated  on  the  second  test.  The  results  failed  to  support  the 
hypothesis.  For  paired -associate  and  free-verbal  situations,  there 
was  no  difference  in  the  amount  of  retention  between  one  and  t\ro 
repetitions  of  given  material. 

In  a  subsequent  experiment  by  Estes,  using  free-verbal  recall, 
each  of  two  groups  was  given  two  reinforced  trials.  The  experimental 
group  was  given  a  test  trial  between  these  two  learning  trials#  Both 
groups  were  then  given  two  successive  test  trials,  and  the  amount  of 

\)n  the  other  hand,  Dotson  (1961)  and  Kristoff arson  (1961), 
using  a  different  experimental  technique,  with  paired  verbal  asso¬ 
ciates,  found  evidence  that  in  this  type  of  learning  situation, 
context  tended  to  nasi:  increments  to  associative  strength  of  pre¬ 
viously  missed  pairs.  In  a  study  dealing  ^rith  a  simple  animal 
learning  situation,  Coppock  &  Freund  (1962)-  using  a  two-choice 
correction  procedure,  found  that  the  probability  of  an  errorless 
response  in  those  rats  which  had  consistently  made  errors  was  not 
constant,  as  required  by  the  all-or-none  model,  but  increased  with 
trials. 
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retention  w as  measured  as  the  proportion  of  instances  in  which  a 
correct  response  to  a  given  stimulus  on  the  first  of  these  tests 
was  repeated  on  the  second  test.  Here  Estes  found  a  marked  differ¬ 
ence  in  favor  of  the  interspersed  test  trial  condition.  Two  rein¬ 
forcements  without  an  intervening  test  yielded  only  $2%  retention, 
whereas  two  reinforcements  with  an  intervening  test  trial  yielded 
7Cf$  retention. 

An  implication  of  Estes1  miniature  ercperinents  seems  to  be  that 
the  "strength11  of  the  association  formed  in  one  trial  is  dependent 
upon  the  presence  of  trials  during  learning  which  are  like  those  that 
will  be  present  during  the  test. 

The  question  iThich  this  work  suggests  is:  Vould  a  combination 
of  a  prompting  trial  and  a  confirmation  trial  be  more  efficient  than 
two  trials  of  conf irmation  alone  or  of  prompting  alone,  for  the  for¬ 
mation  and  retention  of  correct  associations  in  programed  learning? 
It  was  to  test  this  possibility  and  some  related  issues  that  the 
following  e::periment  was  performed. 


SECTION  II.  TIIE  ESaPEREIEHTAL  DESIGN  AND  PROCEDURES 


Under  the  experimental  conditions  of  this  study,  each  frame  of 
a  constructedwresponse  program  contains  a  stimulus  element  and  a 
response  element.  The  stimulus  element  is  uhat  the  subject  readcj 
the  response  element  consists  of  the  correct  response  that  he  is  ex¬ 
pected  to  nal:e  after  reading  the  stimulus  element. 

The  Response  Hod  os 

Under  the  prompting  procedure,  the  correct  response  was  supplied 
to  the  subject  so  that  ho  could  read  it  immediately  after  reading 
the  stimulus  element.  In  the  procedure  used  in  the  experiment,  the 
prompt  was  placed  directly  under  the  blank  space  in  the  frame.  The 
subject  then  copied  the  response  element  which  he  had  just  read  into 
the  blank  space  provided. 

The  pronpting  mode  is  illustrated  below: 

A  variable  that  increases  or  decreases  by  infinitely  small 

amounts  is  called  a  _  variable. 

To  ontinuous  J 

Under  the  confirmation  procedure,  the  answer  was  not  supplied. 
The  subject  was  required  to  construct  a  response  which  he  deemed 
appropriate,  and  to  write  it  into  the  blank  provided  in  the  frame. 

He  then  turned  the  pace  to  read  the  correct  response  element  before 
goinc  on  to  the  next  frame.  Thus,  in  terms  of  the  exa^le  above, 
the  word  "continuous"  would  not  appear  under  the  blank,  but  instead 
would  be  r±y on  on  the  bade  of  the  page. 


By  requiring  an  overt  response  under  the  prompting  condition  as 
well  as  the  confirmation  condition,  the  prompting-confirmation  issue 
was  not  confounded  with  differences  in  overt  and  covert  responses. 
The  only  procedural  differences  between  the  prompting  and  confirma¬ 
tion  conditions  consisted  of  the  relative  position  in  the  frame  at 
which  the  overt  response  was  required  (before  or  after  the  correct 
answer  was  supplied),  and  the  longer  time  delay  between  the  presen¬ 
tation  of  the  stimulus  element  and  the  response  element  under  the 
confiimation  condition, 

Co.'ibinations  of  Response  Modes 

Three  combinations  of  prompting  and  confirmation  were  used  in 
the  study: 

(1)  PP  (prom~)t-pro,.Tpt) ,  Each  subject  irorked  through  all  the 
frames  of  a  lesson  once,  then  immediately  repeated  the  same  lesson 
again.  Both  presentations  of  the  lesson  were  given  under  the 
prompting  condition,  in  which  the  subject  road  the  stimulus  element 
of  each  frame,  with  the  correct  response  immediately  visible  under 
the  blank  space,  and  then  wrote  that  response  into  the  blank  pro¬ 
vided* 

(2)  PC  (prompt-confirm)  *  The  subject  worked  through  the  lesson 
first  under  the  prompting  condition,  and  then  immediately  repeated 
the  lesson  under  the  confirmation  condition*  On  the  repetition,  he 
read  the  stimulus  element  of  a  given  frame,  and  constructed  what  he 
thought  to  be  an  appropriate  response.  Then  he  read  the  correct 
response  on  the  back  of  the  page,  and  found  out  whether  his  answer 


was  correct  or  not* 


(3)  CC  (confirm-confirm) .  The  subject  worked  through  the  lesson 
twice,  each  time  following  the  confirmation  procedure  described  above. 

The  Experimental  Hypotheses 

The  following  hypotheses  were  to  be  tested  by  the  study#  The 
letter  symbols  refer  to  the  combinations  of  response  mocler  defined 
in  the  preceding  section* 

1#  Prompting  is  the  better  condition  for  the  initial  formation 
of  associations  between  the  stimulus  and  response  terms  of  a  frame; 
confirmation  is  the  better  condition  for  strengthening  associations 
already  formed.  Therefore,  PC  should  result  in  fewer  errors  than 
CC  when  the  second  trial,  (-C),  is  used  as  an  acquisition  test,  and 
PC  should  result  in  higher  scores  than  PP  on  a  subsequent  test  of 
retention  of  associations. 

2#  The  prompting  condition  does  not  force  subjects  to  attend 
to  the  crucial  content  of  the  stimulus  term  of  a  frame.  Hence, 
this  condition  :dll  not  be  optimum  for  learning  mediating  concepts, 
as  measured  by  a  transfer  test.  Therefore,  subjects  who  learn  under 
either  the  PC  or  CC  conditions  should  do  better  on  a  transfer  test 
than  those  who  work  under  the  PP  condition. 

3*  The  differential  effects  of  experimental  combinations  (PC, 

CC,  or  PP)  will  not  bo  as  large  for  relatively  bright  students  as 
for  moderate  and  lower  intelligence  levels. 

The  Subjects 

A  total  of  132  high  school  mathematics  students  served  as  sub¬ 
jects.  These  students  were  divided  into  three  intelligence  levels 
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on  the  basis  of  their  scores  on  the  Otis  (Higher  Form  2A)  intelli¬ 
gence  test,  administered  with  a  20-minute  time  limit.  Then  subjects 
were  randomly  assigned  to  the  three  experimental  treatment  groiqps 
(PP,  PC,  CC)  in  such  a  way  that  each  group  contained  the  same  number 
of  persons  at  a  given  intelligence  level.  Of  the  original  sample, 
the  data  from  10?  students  were  retained  for  the  experimental  anal¬ 
ysis,  The  other  subjects  were  eliminated  because  of  absence  during 
any  of  the  training  and  testing  sessions. 

For  the  students  whose  data  were  analyzed,  the  median  scores 
and  their  ranges  for  each  of  the  three  intelligence  levels  are  shown 
in  Table  1, 


Table  1 

0tis-2A  Test  Scores  of  Subjects  Assigned  to  the 
Three  Intelligence  Levels 


Intelligence  Level 
of  Group 

No.  of 
Subjects 

Median 

Score 

Range  of 
Scores 

Low 

27 

38 

«H 

« 

O 

Iloderate 

36 

1*? 

1*2  -  1*8 

High 

1*2 

$k 

1*9  -  61* 

Note,— These  scores  are  based  on  tests  administered  with  a 
20-minute  time  limit. 


Collection  of  the  Data 

Two  lessons  of  an  introductory  Boolean  algebra  program,  con¬ 
sisting  altogether  of  107  frames,  were  administered  on  successive 
days  to  the  subjects.  Each  lesson  required  approximately  30  minutes. 
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L’.ooss-leaf  booklets,  with  one  frame  per  page,  were  used*  For  the 
c«:onfl_rmation  condition,  answers  were  printed  on  the  backs  of  the 
p.*agess#  i-lonitors  were  present  during  the  training  sessions  to  insure 
tl  hat  students  working  under  this  condition  followed  instructions  to 
vrrita  in  a  response  before  checking  the  back  of  the  page  for  an 
auisuar* 

Two  retention  intervals  were  used,  7  and  21  days#  Two  subtests 
we  ere  administered  at  the  end  of  each  of  these  intervals#  One  sub¬ 
tlest  consisted  of  1;2  frames  from  the  lessons,  selected  to  represent 
teeminial  behavior#  The  other  subtest  was  composed  of  transfer  items 
vhftici  the  students  had  never  seen  before,  and  which  required  gener¬ 
alization  of  concepts#  This  subtest  contained  33  iteme#  The  same 
iiam  s  and  items  were  used  at  both  retention  intervals,  but  were 
aaom^od  in  a  different  random  order  for  the  second  interval# 

Types  of  Scores 

Several  different  scores  were  used,  and  were  analyzed  separately 
(1)  The  error  score  was  defined  as  the  number  of  frames  in  which 
ttnsirrrong;  response  had  been  written#  These  scores  were  obtained  for 
aUl  acquisition  trials  under  the  confirmation  condition,  and  on  all 
raeten-tion  interval  tests#  Dach  subjects  error  score  for  the  33 
tnranster  item  subtests  was  multiplied  by  U2/33  to  siirylify  the  anal¬ 
yses  of  variance  involving  both  repeated  items  and  transfer  items# 

^2)  The  proportion-retained  retention  score  was  defined  as  the 
proportion  of  frames  correct  on  the  first  retention  test  that  were 
alAso  correct  on  the  second  retention  test# 
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(3)  The  ran  retention  score  nas  the  number  of  wrong  responses 


on  either  repeated-frame  or  transfer  subtests  civen  at  the  7-rod 


21<lay  retention  intervals, 

(U)  The  time  score  was  the  amount  of  time,  to  the  nearest  min¬ 
ute,  taken  during  the  learning  session. 


aSCTIOII  III.  RESULTS 


The  statistical  analyses  are  summarized  in  Tables  2  through  0, 
Analysis  of  the  Error  Scores 

Table  2  presents  mean  error  scores  for  the  PC  and  CC  experi¬ 
mental  Groups,  the  two  groups  in  which  acquisition  scores  could  be 
obtained.  For  the  PC  combination.  Trial  1  responses  were  prompted, 
and  consequently  there  were  no  opportunities  to  make  errors.  Over¬ 
all  error  scores  on  Trial  2  were,  however,  about  as  high  as  those 
for  the  corresponding  trial  for  the  CC  combination.  The  low  and 
high  groups  had  low  error  scores  on  Trial  2  for  the  CC  combination; 
the  middle  group  had  low  error  scores  under  the  PC  condition.  In 
statistical  terms,  this  suggests  a  significant  interaction  between 
intelligence  levels  and  treatment  groups.  In  the  discussion  of  the 
analysis  of  variance  of  these  data,  which  follows ,  this  suggested 
interactive  effoct  is  confirmed. 

The  analysis  of  variance  of  these  acquisition  error  data 
(Trial  2)  for  the  PC  and  CC  groups,  and  of  the  error  scores  for  the 
repeated-item  subtests  for  these  two  groups,  is  summarized  in  Table  3. 
In  this  analysis.  Trial  2  data  were  analyzed  with  retention  test  data. 
These  error  scores  are  based,  then,  on  one  immediate  and  two  delayed 
(7  and  21  days)  tests. 

Differences  among  retention  levels  are  seen  to  be  significant 
act  the  .01  level,  as  are  the  differences  among  intelligence  levels. 
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Table  2 


Means  and  Standard  Deviations  of  Acquisition  Error 
Scores  Obtained  by  CC  and  PC  Groups 
Arranged  by  Intelligence  Levels 


Treatment 

Intelligence 

N 

Trial  la 

Trial  2b 

Group 

Level 

Hean 

m 

Hean 

SD 

Low 

9 

11.00 

7.79 

6.78 

6.13 

Average 

12 

12.58 

5.63 

8.1t2 

2.72 

CC 

High 

Hi 

7.21 

h.33 

2.21 

2.51 

All  levels 

35 

10.03 

6.30 

5.5l 

U.73 

Low 

9 

— 

— 

9.56 

U.00 

Average 

12 

— 

3.25 

2.83 

PC 

High 

lit 

— 

!*.93 

3.9U 

All  levels 

35 

— 

— 

5.51* 

1*.38 

®0n  Trial  1  for  the  PC  combination,  there  were  no  opportunities 
to  make  errors. 


u 

All  cains  botwoen  Trial  1  and  2  were  statistically  significant 
at  the  .05  level  for  the  Low  and  Average  groups,  and  at  the  .01  level 
for  the  High  groups  or  fcr  the  combined  subgroups  of  either  treatment 
group. 


On  the  other  hand,  the  main  effect  for  treatment  groups  (CC  vs.  PC) 
is  not  significant.  Since  intelligence  levels  and  treatments  inter¬ 
act  significantly,  the  nonsignificance  of  this  treatment  effect  ap¬ 
parently  can  be  attributed  to  the  canceling  effects  of  various  in¬ 
telligence  levels  within  a  given  treatment  category. 
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Table  3 


Analysis  of  Variance  of  Acquisition  and  Retention  Error 
Scores  for  Repeated-Frame  Subtests 
for  CC  and  PC  Groups 


Source  of  Variation 

df 

Sum  of 
Squares 

Mean 

Square 

? 

Between  Subjects 

69 

6,567.60 

Intelligence  levels 

2 

2,573.75 

1,286,87 

2k.225** 

Treatments 
(CC  vs,  PC) 

i 

U3.89 

k3.89 

0.827 

Intelligence  levels 

X  treatments 

2 

550.20 

275.09 

5.178*# 

Error  (b) 

6k 

3,399.76 

53.121 

Kithin  Subjects 

mo 

6,19k, 00 

Retention  intervals 

2 

3,370,9k 

l,689.k7 

09.k56## 

Retention  intervals 

X  intelligence  levels 

i* 

358.59 

89.6k 

k.7k7* 

Retention  intervals 

X  treatments 

2 

29.3k 

lk.67 

.777 

Retention  intervals 

X  intelligence  levels 

X  treatments 

k 

9.76 

2,kk 

.129 

Error  (it) 

128 

2,kl7.37 

18.886 

^Significant  at  ,05  level, 
■^Significant  at  ,01  level. 
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There  was  also  a  significant  interaction  between  intelligence  levels 
and  retention  intervals,  due  primarily  to  the  differences  among  imme¬ 
diate  and  7-day  retention  interval  means  for  the  three  intelligence 
levels . 

Table  It  summarizes  mean  error  scores  on  retention  subtests 
(7-and  21-day  intervals,  repeated  and  transfer  items)  for  all  three 
treatment  groups  and  the  three  intelligence  levels.  In  general,  the 
subjects  did  better  on  the  repeated-frame  subtests  than  on  the 
transfer  subtests.  The  differences  between  repeated-frame  and 
transfer  subtest  scores  were  statistically  significant  at  the  ,01 
level.  Differences  between  the  7-day  and  21-day  retention  inter¬ 
vals  were  not  significant.  As  mentioned  in  connection  with  the 
analysis  of  Table  3,  most  forgetting  occurred  in  the  first  seven 
days.  The  analysis  of  variance  of  the  7-  and  21-day  retention  test 
data  in  Table  li  is  presented  in  Table  5* 

Analysis  of  the  Proportion  Retained  Retention  Scores 

A  measure  of  retention  available  from  repeated  tests  is  the 
number  of  items  correctly  answered  on  the  second  test  that  were  also 
answered  correctly  on  the  first.  This  measure  has  been  used  in 
paired-associate  studies  (Estes,  I960),  There  the  assumption  was 
that  associations  are  formed  on  an  all-or-none  basis,  and  hence 
that  the  proportions  of  correct  responses  following  incorrect  re¬ 
sponses  on  repeated  tests  should  be  no  better  than  choice. 

This  measure  was  computed  for  the  repeated -frame  subtest,  for 
the  7-  and  21-day  retention  intervals.  These  proportions  are  sum¬ 
marised  in  Table  6,  The  use  of  this  criterion  of  retention  partials 


-13' 


Table  1* 


Summary  of  Hean  Error  Scores  on  Retention  Subtests 
Obtained  by  Three  Treatment  Groups  at  Three 
Intelligence  Levels 


Intelligence 

Level 

N 

Retention  Intervals 

Repeated  Frames 

Transfer  Items® 

7  days 

21  days 

7  days 

21  days 

( C onf irmation-C onf i nnat ion  group) 

Low 

9 

18,11 

18.8? 

23.90 

2l*.77 

Iloderate 

12 

18.33 

19.75 

23.98 

2l*,l8 

High 

ll( 

9.21 

8.00 

IU.I4.6 

12.00 

All  levels 

3? 

lit.63 

U*.83 

20.15 

19.1*6 

( Prorpting -C onf irmat ion  group) 

Low 

9 

20.00 

19.33 

2  5.33 

28.28 

Iloderate 

12 

13.33 

13.75 

19.95 

18.98 

High 

ll* 

9.86 

8.36 

15.27 

13.27 

All  levels 

35 

13.66 

13.03 

19.1*6 

19.09 

( Prompting -Prompting  group) 

Low 

9 

21.1*1* 

21.78 

29.29 

27.73 

Iloderate 

12 

15.53 

ll*.50 

19.72 

19.62 

High 

35 

9.50 

9.79 

15.5U 

13.10 

All  levels 

35 

lli.66 

ll*.l*9 

20.51 

19.10 

Weighted  by  a  factor  of  1*273  to  equate  the  33  transfer  items 
with  the  U2  repeated  frames* 


Table  5 


Analysis  of  Variance  of  Retention  Error  Scores  for  Three 
Treatment  Groups  at  Three  Intelligence  Levels 

(Based  on  scores  obtained  on  tests  at  7-  and  21-day  intervals) 


Sum  of  Mean 

Source  of  Variation  df  Squares  Square  F 


Between  Subjects 

Intelligence  levels 
Treatments  (PP,  PC,  CC) 
Intelligence  levels  X  treatments 
Error  (b) 

Within  Subjects 

Retention  intervals 
Retention  intervals 
X  intelligence  levels 
Retention  intervals 
X  treatments 

Retention  intervals  X  intelli¬ 
gence  levels  X  treatments 
Error^  (w) 

Item  type  (Repeat  vs.  transfer) 
Item  type  X  intelligence  levels 
Item  type  X  treatments 
Item  type  X  intelligence  levels 
X  treatments 
Error2  (w) 

Retention  intervals  X  item  type 
Retention  intervals  X  item  type 
X  intelligence  levels 
Retention  intervals  X  item  type 
X  treatments 

Retention  intervals  X  item  type 
X  intelligence  levels 
X  treatments 
Error^  (w) 

Total 


101* 

23,722.21* 

2 

9,51*0.07 

1*,  770.03 

3l*.679** 

2 

79.13 

39.56 

.288 

1* 

897.80 

22l*.l*7 

1.632 

96 

13,205.16 

137.55 

315 

6,50lw89 

1 

27.67 

27.670 

2.53U 

2 

79.31* 

39.670 

3.653* 

2 

5.25 

2.675 

.21*0 

1* 

28.31 

7.053 

.61*6 

96 

1,01*8.16 

10.917 

1 

3,078.02 

3,078.020  179.518** 

2 

55.95 

27.975 

1.632 

2 

H*.55 

7.275 

.1*21* 

1* 

7.17 

1.793 

.105 

96 

1,61*6,00 

17.11*6 

1 

10.31 

10.310 

2.292 

2 

18.12 

9.060 

2.011* 

2 

10.72 

5.360 

1.192 

1* 

1*3.60 

10.900 

2.1*23 

96 

1*31.82 

1*.1*98 

105 

30,227.13 

■^Significant  at  ,05  level, 
^Significant  at  ,01  level. 
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out  the  effects  of  differences  in  the  amount  originally  learned. 
Hence,  Table  6  indicates  that  rate  of  forgetting  is  correlated  with 
intelligence.  However,  there  is  no  evidence  in  Table  6  that  the 
different  experimental  conditions  affected  strength  of  associations 
differentially,  except  for  the  moderate,  or  middle,  intelligence 
group.  Their  retention  scores  were  slightly  worse  under  the  CC 
condition  than  under  the  other  two  conditions. 


Table  6 

Proportions  of  Same  Frames  Correct  on  Both  First  (7-day) 
and  Second  (21-day)  Retention  Tests 


Intelligence 

Level 

Treatment  Group 

CC 

PC 

PP 

Low 

.71 *9 

.751* 

.751 

Moderate 

.753 

.836 

.82  9 

High 

.928 

.919 

.881* 

All  levels 

.822 

.81*8 

H 

GO 

• 

Analysis  of  the  Time  Scores 

There  is  some  practical  interest  in  the  times  required  for  ac¬ 
quisition  under  different  procedures.  It  is  obvious  that  where 
write-in  responses  are  conpared  with  covert  or  implicit  responding, 
the  former  will  be  slower.  However,  in  this  study,  write-in  re¬ 
sponses  wore  always  required,  no  matter  what  combination  of  pronpting 
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and  confirmation  were  involved.  Nevertheless,  as  can  be  seen  in 
Table  7,  the  PP  condition  yielded  lower  training  time  means.  This 
reflects  the  time  required  for  the  subject  to  try  to  think  of  the 
correct  answer  under  the  conditions  involving  confirmation. 


Table  7 

Means  and  Standard  Deviations  of  Training  Times 
(Minutes)  for  Three  Treatment  Groups 
at  Three  Intelligence  Levels 


Intelligence 

Level 

Treatment  Group 

CC 

PC 

PP 

Mean 

SD 

Mean 

SD 

!!ean 

SD 

Low 

63.1 

Hu3 

63.1 

7.9 

50.3 

U*.3 

Moderate 

60.9 

9.6 

58.7 

10.6 

51.7 

10.5 

High 

59.2 

8.2 

52.3 

6.0 

1*3.9 

3.6 

All  levels 

60.0 

10.9 

57.3 

9.6 

1*8,2 

10.9 

The  analysis  of  variance  of  these  time  scores,  shown  in  Table  8, 
indicates  that  the  time  differences  between  experimental  groups  are 
significant  at  the  .05  level. 
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Table  8 


Analysis  of  Variance  of  Training  Times  for  Three  Treatment 
Groups  at  Three  Intelligence  Levels 


Source  of  Variation 

Sum  of  Squares 

df 

Ilean  Square 

F 

Intelligence  levels 

2,91*1.257 

2 

1,1*70.629 

13.817## 

Treatments 

96^.080 

2 

1*82.51*0 

l*.533# 

Intelligence  levels 

X  treatments 

237.207 

1* 

59.302 

.557 

Error  (*dthin  cells) 

10,218.171 

96 

106.1*39 

Total 

lit, 361. 715 

ioU 

^Significant  at  ,05  level. 
##3ignificant  at  .01  level* 
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SECTION  IV.  DISCUSSION 


The  study  found  inconclusive  support  for  the  hypothesis  that 
the  PC  combination  is  superior  to  CC  for  acquisition  and  to  PP  for 
retention.  Treatments  were  not  significant  as  a  main  effect  in  the 
analyses  of  variance  (Tables  3  and  it) «  During  acquisition,  subjects 
in  the  hi^h  and  low  intelligence  levels  made  fewer  errors  under  the 
CC  than  under  the  PC  combinations.  However,  those  in  the  middle 
intelligence  level  made  fewer  errors  under  the  PC  than  the  CC  com¬ 
bination  during  acquisition  (Table  2).  Uhile  some  of  these  simple 
effects  were  statistically  significant,  they  diminished  over  the 
7-  and  21-dsy  retention  intervals.  The  brightest  students  did  learn 
more  and  did  retain  it  better  than  the  others,  which  led  to  a  sig¬ 
nificant  interaction  between  intelligence  levels  and  retention  in¬ 
tervals  (Tables  3  and  5) .  The  data  for  the  transfer-item  subtests 
are  negative*  The  treatment  combinations  had  no  statistically  sig¬ 
nificant  differential  effects  on  transfer  of  concepts  to  new  prob¬ 
lems  (Tables  U  and  $)» 

These  results  are  in  general  agreement  with  other  studies  of 
prorqpting  and  confirmation  suranarized  by  Silberman  (1961).  When 
these  variables  are  studied  in  the  context  of  programmed  instruc¬ 
tion,  either  no  differences  are  found,  or  differences  are  small  and 
of  little  practical  significance. 

Results  of  paired-associate  and  siiqple  rote  learning  studies 
concerned  with  these  variables  (Cook  &  Kendler,  1956;  Angell  & 
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Lumsdaine,  I960;  Stolurow,  l?6l)  are  usually  more  definitive*  Paired- 
associate  studies  have  found  strong  evidence  that  prompting  is  a 
superior  condition  for  acquisition  of  associations.  Stolurow  found 
that  prompting  groups  did  better  than  confirmation  groups  on  both 
recall  and  recognition  tests,  but  that  amount  of  overlearning  also 
influenced  the  obtained  results.  Angell  and  Lumsdaine,  using  Cook's 
stimulus  materials,  found  prompting  in  only  three  trials  out  of  four 
superior  to  either  prompting  or  confirmation  alone  on  every  trial. 

Although  there  is  a  temptation  to  assume  that  the  paired- 
associate  model  fits  programmed  instruction  of  verbal  material,  the 
two  learning  situations  clearly  are  different  in  important  respects* 
The  stimulus  terms  of  paired  associates  are  carefully  constructed 
not  to  have  prior  associational  value  for  their  response  terms,  and 
interitem  associations  are  similarly  minimized.  The  opposite  is  true 
of  programmed  instruction.  Frames  are  carefully  constructed  to  make 
correct  responses  obvious;  highly  overleamed  verbal  symbols  are 
used;  and  mediating  concepts  interrelate  the  successive  frames* 

Under  these  conditions,  it  is  likely  that  prompting  and  confirmation 
are  relatively  weak  variables  in  conparison  to  the  response  control 
exerted  by  the  cues  in  the  stimulus  elements  and  by  the  concepts 
interrelating  the  frames* 
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